Reducing Runtime by Recycling Samples
نویسندگان
چکیده
Contrary to the situation with stochastic gradient descent, we argue that when using stochastic methods with variance reduction, such as SDCA, SAG or SVRG, as well as their variants, it could be beneficial to reuse previously used samples instead of fresh samples, even when fresh samples are available. We demonstrate this empirically for SDCA, SAG and SVRG, studying the optimal sample size one should use, and also uncover behavior that suggests running SDCA for an integer number of epochs could be wasteful.
منابع مشابه
Thermoeconomic analysis of reducing exergy losses in greenhouses with hydroponic cultivation system through drainage recycling and formation of water quality pyramid
Employing non-conventional water resources using treatment and recycling is considered as the main resource in addressing future water scarcity. Although non-conventional water recycling has been investigated in details in the literature, its impacts on irrigation-fertilizing systems have not been discussed using thermoeconomic analysis. In this case study, using a hydroponic greenhouse system...
متن کاملCycle Time Reduction and Runtime Rebalancing by Reallocating Dependent Tasks
Business Process Management Systems (BPMS) is a complex information system that provides designing, administrating, and improving the business processes. Task allocation to human resources is one of the most important issues which should be managed more efficiently in BPMS. Task allocation algorithms are defined in order to meet the various policies of organizations. The most important of these...
متن کاملInvestigating levels of aflatoxin B1 exposure through the settled dust in the working environment in workers of the dry and wet household waste sorting of the recycling industry
Background & Aim: Aflatoxin B1 (AFB1) acts as a genotoxic, cytotoxic, and a potential hepatocarcinogen agent. Any contact with aflatoxins is a main threat to workers in the waste management industry. On the other hand, just a few studies have investigated occupational exposure to mycotoxins in the aforementioned industry. In this study, the exposure level of workers to dust and AFB1 has been in...
متن کاملAnalysis of the strength of hot in-place recycled asphalt, its affecting factors and its comparison with conventional methods
In recent decades, economic development and population growth in the world has led to the expansion of road networks. Therefore the use of optimum methods for repairing and maintenance of these roads is considered as an important value. Today one of the options in this regard, is the use of asphalt recycling technology. The present study which took place in the summer of 2015 in Iran, Lorestan ...
متن کاملWaste oil management: Analyses of waste oils from vehicle crankcases and gearboxes
In accordance with waste strategy for Turkey, the study was carried out to analyses waste engine crankcase oils and waste gearbox oils generated from vehicle maintenance services in order to determine their suitability for recycling, recovery or final disposal based on regulation published by Turkish Ministry of Environment and Forestry on 21 January 2004. The regulation requires all waste oil ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- CoRR
دوره abs/1602.02136 شماره
صفحات -
تاریخ انتشار 2016